Cooperativity, sensitivity and noise in biochemical signaling 
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Cooperative interactions among tiie binding of multiple signaling molecules is a common mechanism for 
enhancing the sensitivity of biological signaling systems. It is widely assumed that this increase in sensitivity 
of the mean response implies the ability to detect smaller signals. We show that, quite generally, there is a 
component of the noise in such systems that can be traced to the random arrival of the signaling molecules at 
their receptor sites, and this diffusive noise is not reduced by cooperativity. Cooperativity makes it easier for 
real systems to reach this physical limit, but cannot reduce the limit itself. 



In biological systems, many signals are carried by changes 
in the concentration of various molecules, from small 
molecules such as cyclic nucleotides to proteins such as the 
transcription factors that regulate gene expression. A strik- 
ing feature of these systems is their sensitivity: concentra- 
tions can be quite small in absolute terms, and small fractional 
changes in concentration can have a significant effect. Thus, 
many transcription factors achieve their half maximal effect at 
nanoMolar concentrations 1 1 ], corresponding to just a handful 
of molecules per cubic micron, changes in the concentration 
of a particular phosphorylated protein by less than ^ 10% 
can produce reliable differences in the output of the bacterial 
flagellar motor |2], and so on. A natural question about the 
physics of these systems concerns the origins of this sensitiv- 
ity and its ultimate limits. 

A central theme in much of biological regulation is the idea 
of cooperativity or allostery |2l|4|,|5|]: binding of multiple lig- 
ands at different sites on a single protein molecule can interact 
so that the mean occupancy of these sites has a very steep de- 
pendence on ligand concentration. Indeed, conventional mod- 
els predict that cooperative effects among a large number of 
sites can produce arbitrarily high sensitivity. But there is a 
difference between sensitivity in the mean response and a re- 
liable response to small changes — there are limits to measure- 
ment which cannot be evaded just by having an amplifier with 
a higher gain. Here we consider the "noise floor" for detec- 
tion of small concentration changes by a receptor that exhibits 
cooperativity, or more generally multiple internal states in re- 
sponse to binding of multiple ligands. We find that while co- 
operativity can reduce the effective noise level against which 
small signals must be discriminated, there is a physical limit 
set by the size of the receptor, the diffusion constant of the 
signaling molecule and its absolute concentration. Thus coop- 
erativity can make it easier to approach this limit (as with high 
gain amplifiers), but cooperative systems do not have a funda- 
mentally lower noise floor than non-cooperative systems. 

The classical discussion of noise in biochemical signaling 
is by Berg and Purcell |6]. Their arguments were heuristic, 
suggesting that one should think of receptors with size i as 
counting molecules in a volume ^ The Poisson statistics 
of counting then set a limit to precision which can be reduced 
by averaging over time, but one must wait a time ^ /D for 
the volume to be cleared by diffusion before making a gen- 



uinely independent measurement. The end result is that if one 
averages for a time Tavg then one can detect fractional changes 
in concentration 
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Bacterial chemotaxis actually seems to operate close to this 
limit 1 6]. The discussion of noise has been invigorated by ex- 
periments that measure directly the noise in the regulation of 
gene expression |7|, and much theoretical work is focused on 
connecting these data to specific kinetic models |8]. Recently 
we have argued that even for these more complex systems, 
there is a limit analogous to that derived by Berg and Purcell, 
which should be independent of the (often unknown) kinetic 
details j^. Our argument was based on the idea that bind- 
ing of signaling molecules to their receptor sites usually is an 
equilibrium process, so that fluctuations in the occupancy of 
the sites becomes a form of thermal noise that can be analyzed 
using the fluctuation-dissipation theorem. The first analysis 
considered multiple binding sites, in particular allowing us to 
show how correlations among site occupancies leads to be- 
havior that approximates a single larger receptor, but we did 
not consider interactions among the sites. 

To analyze the case of cooperative interactions we begin 
with a very general scenario, and then show how this general 
analysis works out for a specific model. Consider a receptor 
molecule or complex that has many states labeled by an index 
i; the population of each state is pi. In the state i, Ui signal- 
ing molecules are bound, so that the free energy of this state 
is Fi = Ei — riifi, where /i is the chemical potential of the 
signaling molecule measured at the location of the receptor. 
As usual for a solution at low concentration, /i = k bT In c, 
where c is the concentration in appropriate units. The chem- 
ical kinetics of this system (which we don't specify in detail) 
determine some linear response of the populations to changes 
in the free energies. In the frequency domain. 
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where we assume that all binding and unbinding of the signal- 
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ing molecules can be considered to occur at a single location 
Xq of the receptor. 

The susceptibility Xiji^) can encode complex interactions 
among different binding sites, since it describes all possi- 
ble states of the receptor complex. In particular, if there are 
two binding sites which can be empty or occupied, there are 
four possible states, which we can label i = {00, 01, 10, 11}. 
Positive cooperativity in this simplest of models is the state- 
ment that the energy decrease on binding the second ligand 
is greater than on binding the first ligand. En — Eiq < 
Eio — Eqq. More complex (and realistic) models ascribe 
the cooperativity not to direct interaction between the bind- 
ing sites but rather to an interaction between the binding and 
some other conformational degrees of freedom in the receptor, 
as in the Monod-Wyman-Changeaux model discussed below. 

To continue, we need to count how many signaling 
molecules are bound to the receptor, and then changes in this 
number act as a source or sink for diffusion. The total number 
of bound ligands is ntotai — J2i "iPi' ^'^'^ hence the diffusion 
equation for the signaling molecule becomes 

^'^(^'^^ = WMx,t)-<5(x-xo)5:ni^. (4) 



dt 



We can solve explicitly for the response to small changes in 
the populations, again working in the frequency domain: 
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In particular, to substitute into Eq Q we need to evaluate the 
concentration at the location of the receptor itself 
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The term in brackets is ultraviolet divergent because we treat 
the receptor as a point object. As in Ref |9] we remove the 
divergence by cutting off the k integrals at a scale fc„iax ^ 
tt/£, where £ is the size of the receptor site. Then we find, in 
the low frequency limit u ^ D /l"^. 
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Equation (0 tells us how the concentration responds to 
changes in the population of the different states of the receptor 
complex, while Eq (|3} tells us how the populations respond to 
changes in concentration. In effect the diffusing concentra- 
tion field keeps a history of the state dynamics, and therefore 
renormaUzes the kinetics, as shown explicitly for a simpler 
case m Ref fg*]. To finish the calculation we substitute from 
Eq into (|3} and invert the matrix relations to obtain 
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where denotes the ij element of the matrix inverse to Xiy 
We see that the effect of coupling to diffusion is to add a 
self-energy term to the inverse susceptibility, so that 
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The fluctuation-dissipation theorem tells us that the fluctua- 
tions in occupancy of the states can be thought of as the re- 
sponse to fluctuations in the conjugate energies Ei, and the 
spectrum of these fluctuations is determined by the inverse 
susceptibility fioll : 
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If we define the noise power spectrum through 

{5Ei{uj)5%{uj')) = 27rJ(w + w')Mj(w) 
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where Af^^^ is the noise we would calculate just from the ki- 
netics described by the bare susceptibility • 

We see from Eq (|3} that a change in concentration is equiv- 
alent to a coordinated change in the energies of all the states. 
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Because the change in concentration produces changes in the 
free energies of many different states, in general there is no 
single state of the receptor complex that can be monitored to 
provide the optimal readout of the concentration. If we imag- 
ine, however, that downstream mechanisms have access to all 
the states, and can form a readout constructed as a weighted 
average of the populations, then by choosing the weights ap- 
propriately one can achieve the maximum possible signal to 
noise ratio at each frequency 

SNR{lu) = ^Ai?i(w)AAiri(w)A£;*(a;) (14) 
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In the limit that we are trying to detect a slow change in con- 
centration, and we are willing to average for a time Tavg, the 
total signal-to-noise ratio is given by TiivgSNR{LLj — > 0). 
Defining the detectability as the point where this total signal- 
to-noise ratio reaches unity, the threshold for detection is 
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The sum in Eq il6\ is a quadratic form, n^ A/^^^ n, where 
the vector n has components nj. If we define u to be unit 
vector parallel to n, then we can write 

(u'^-A/'-u)uu^+A/'j_, (17) 



3 



where the matrix J\f± acts only in the subspace orthogonal to 
n, and then n^ A/^^^ n = Inl /{u^-M-u) . From Eg ( I12t . 
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Putting all of the factors together, we have 
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Crucially, the second term in brackets is positive, because it is 
a quadratic form constructed from the matrix of noise power 
spectra. Thus we have, exactly as in Ref |^, 
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where stuff is positive and hence the first term provides a 
lower bound the smallest detectable signal. This term is, ex- 
cept for the factor of tt, exactly the expression in Eq Q, de- 
rived heuristically by Berg and Purcell 0]. 

To illustrate these ideas, it is useful to think about a spe- 
cific model, the Monod-Wyman-Changeux model of co- 
operativity |3], schematized in Fig Q The MWC model 
has been widely used, first for allosteric enzymes, then for 
the paradigmatic example of cooperative oxygen binding to 
hemoglobin L5J, and more recently for the analysis of the 
clockwose/counterclockwise switching of the bacterial flag- 
ellar motor fl^ [l3i I14I1 . In this model, ligands bind indepen- 
dently to multiple sites, but the binding energy depends on 
whether the whole complex is in the RorT state 1 15|]. 

Quantitatively, the states of the system are defined by the 
binary variable R/T and the number n of ligands bound to a 
total of Nr sites. We can write the free energy of the R state 
with n ligands bound as 
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and similarly for the T states, where c is the ligand concen- 
tration as above. If the rate for ligand binding to the R state 
[i.e., for the transition (i?, n) {R, n + 1)] is k^c and the 
rate of unbinding is k^, then k^/k^ — Kr. If the transition 
(i?, n) (T, n) occurs at rate kf{n), and the reverse T ^ R 
transition at rate kb{n), then by detailed balance around the 
loops in Fig n we must have 
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To complete the kinetic model we follow Ref f\3\ and assume 
that the activation energies for the transition rates kf,i,{n) are 
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FIG. 1 : The Monod-Wyman-Changeux model for cooperative bind- 
ing 01, shown here as used in i]M to describe the bacterial flagel- 
lar motor. There are Nr sites at which the ligand can bind, and all 
binding events are independent, but the binding energy depends on 
whether the whole complex is in the R or T state. In this case the 
binding is stronger in the T state, so that by detailed balance the 
equilibrium shifts toward T (shown schematically by the horizontal 
arrows) as more ligands bind. 



themselves linear in n, so that 
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In this model the equilibrium probability of being in the T 
state (summing over n) is given by 
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where L = exp [-(Ft(0) - FR{0))/kBT]. In the limit that 
there are very many binding sites (Nr 00) and binding to 
the T state is much stronger than to the R state (Kr ^ Kt), 
Pt approaches a step function dependence on concentration. 
In this sense, the MWC model allows for arbitrarily high sen- 
sitivity if there are enough binding sites that can cooperate. 

In the (plausible) limit where the conformational transition 
is slow but the binding and unbinding of the ligands is fast, 
the dynamics reduces to a two-state system (R and T) and we 
can compute the transition rates as averages of the fc/ f, over 
the equilibrium distribution of n given that the system is in 
either the RotT state. Once we have this effective two state 
system, we have to couple the transitions to diffusion of the 
ligand as before, and then follow the same steps through the 
fluctuation-dissipation theorem to the effective noise level for 
concentration measurements, as in Ref [9]. We outline the 
argument here and give details elsewhere. 
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Given that the system is in the R state, the equiUbrium dis- 
tribution of the number of Ugand molecules bound is binomial 
because the binding events are independent: 
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where the fractional occupancy is fj^ — c/(c+Kj^), and there 
is an identical equation for the T state. Then the average rate 
kf for transitions from i? to T is given by 



kf = ^p(n|i?)A:/(n) 
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where we use fc/ (n) from Eq i24\ . The same argument for the 
T state yields 
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and the dynamics of the T state population is given by 
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In the R state the mean number of ligands bound is just ur — 
Nj.fR and similarly in the T state, so that transitions from the 



T to R state are associated with the release of Nrifr — Jr) 
molecules into the surrounding solution. Hence the diffusion 
equation analogous to Eq (0} becomes 
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Solving Eq ( I32> to compute the response of c to small 
changes in px follows the same steps as for Eq (|4}, with the 
result that 
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The analysis of Eq OH is more subtle because the concentra- 
tion c and the thermodynamic force conjugate to px are hid- 
den in the rate constants kf,b- The conjugate force is the free 
energy difference between the T and R states, and is linked to 
the rate constants through detailed balance. Thus if we imag- 
ine changing the rate constants kf\i, by small amounts Skf^b, 
we must have (see also Ref |9]) 
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as can be verified by detailed computations from Eq's ( I29I I and 
(l30l . identifying F = Fr{0) - Ft(0). Linearizing Eq (EB 
thus yields 



dSpT 
dt 



-{kf + kb)SpT + Skf{l -pr) - SkbPr 

-Ckf + ~kb)SpT + -r^[kf{l-PT)] - -Ti^ikbpT] 
kf Kb 



-{kf + kb)SpT + [kf{l - pr)] 
-{kf + kb)SpT-i-[kf{l-pT)] 



Skf_ 

~kf 
SF 
k^ 



Skb 
h 



/«)- 

c 



(35) 
(36) 

(37) 

(38) 



where we have used the fact that the equilibrium occupancy of the T state satisfies kf{\ — px) = kbPr, corresponding to 
dpT /dt = in Eq MW . Fractional changes in concentration are equivalent to changes in free energy through 
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so if we can compute the noise in SF we can compute the equivalent noise in the concentration, as before. 

To find the susceptibility of pr to its conjugate force SF we transform Eq ( I38> and substitute from Eq i33\ to give 
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The fluctuation-dissipation theorem, as in Eq but now with the more standard sign convention fioll . tells us that 
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By analogy with the arguments above this resuh, combined with Eq ( I39I I means that the equivalent concentration noise level is 
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We see that this is exactly of the form found in our more gen- 
eral analysis, except that now we can give the stuff of Eqdnj 
an explicit form. In particular, as the number of cooperative 
sites Nr becomes large, this extra term becomes small, and the 
physical limit set by diffusion alone becomes more dominant. 

To summarize, we have found that the physical limit to bio- 
chemical signaling first suggested by Berg and Purcell is sur- 
prisingly general. Even allowing for arbitrarily complex in- 
ternal states and multiple ligand binding sites, the equivalent 
noise level against which concentration changes must be de- 
tected has two terms: the Berg-Purcell limit plus a positive 
contribution from the details of the chemical kinetics. Co- 
operative interactions serve to suppress the second term, and 
perhaps this is crucial in allowing any real biological system 
to approach the physical limit. We conclude by recalling an- 
other of the heuristic arguments offered by Berg and Purcell 
101 • They suggested that one should view chemical sensing as 
molecule counting, and then by analogy with photon counting 
the physical limit is set by shot noise in the flux; the differ- 
ence is that for molecules the flux is set by diffusion. Our 
results are completely consistent with this point of view: we 
can think of the detailed kinetics of the system as "processing" 
the input flux, and then noise can be added in this processing 
but of course the shot noise cannot be reduced. Cooperativity 
provides for a high gain in response to the input and hence 
reduces the impact of extraneous noise sources. 
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